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SUMMARY 

In this paper, we investigate convergence dynamics of 2^ almost periodic encoded patterns of 
general neural networks (GNNs) subjected to external almost periodic stimuli, including almost 
periodic delays. Invariant regions are established for the existence of 2^ almost periodic encoded 
patterns under two classes of activation functions. By employing the property of ^#-cone and 
inequality technique, attracting basins are estimated and some criteria are derived for the networks 
to converge exponentially toward 2^ almost periodic encoded patterns. The obtained results are 
new, they extend and generalize the corresponding results existing in previous literature. 

KEY WORDS: neural networks; almost periodic; encoded patterns; attracting basins; exponential 
stability 



1. INTRODUCTION 

In recent years, the dynamical behaviors of neural networks with delays have been widely 
investigated. Many important results on the existence and uniqueness of equilibrium point, 
global asymptotic (exponential) stability have been established and successfully applied to 
signal and image processing system, associative memories, pattern classification and so on. 
For corresponding results, we can refer to [1-9,17-18,34-36]. In the applications of neural 
networks to associative memory storage or pattern recognitions, the existence of multiple 
equilibria or multiple periodic orbits is an important feature [1-3,6-9]. It is worth noting 
that convergence analysis and coexistence of multiple equilibria or multiple periodic solutions 
have been investigated in [6-8] and these equilibria or periodic solutions are usually called 
encoded patterns [6-8,10]. 

As we know well, the nonautonomous phenomenon involved in periodic or almost periodic 
environment often occurs in many realistic systems [11-14,19]. Hence, in many applications, 
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the property of periodic or almost periodic oscillatory solutions of neural networks is of 
great interest. Meanwhile, there often exist delays in artificial neural networks due to the 
finite switching speed of amplifiers and faults in the electrical circuit. They slow down 
the transmission rate and lead to some degree of instability. Therefore, complex dynamic 
behaviors of neural networks under periodic or almost periodic stimuli and delayed effects 
have been studied so far [10,15-16,20-31,37,39,41]. 

However, to the best of the authors' knowledge, few papers deal with general neural 
networks with both almost periodic coefficients and almost periodic delays. Furthermore, 
most of the results reported in the literature focus on the stability of unique almost periodic 
solution of neural networks. We can refer to [10,20-23,39] and the references cited therein. 
In this paper, similarly as [26,31], we consider the following nonautonomous general neural 
networks with transmission delays 



where i, jeJ^:={l, 2, • • • , TV}, :={1, 2, • • • , M}; The main purpose of this paper is to 
study complex convergence dynamics of GNNs (1) in encoding external stimuli that vary 
almost periodically with time and recalling the encoded patterns associated with almost 
periodic delays. That is, we investigate exponential stability of 2 N almost periodic encoded 
patterns (almost periodic solutions) of GNNs (1). The criteria we established are completely 
different from most of the existing results in [10,20-31]. Particularly, when GNNs (1) de- 
generates into the autonomous system, our results extend and generalize the related results 
existing in [6,8]. 

The rest of this paper is organized as follows. In Section 2, we shall make some prepara- 
tions by giving some definitions and lemmas. Meanwhile, we establish 2 N positively invariant 
basins for general neural networks under almost periodic stimuli. In Section 3, by using the 
property of ^-cone and inequality technique, attracting basins are determined and some 
new criteria for exponential stability of 2 N almost periodic encoded patterns are obtained. 
In Section 4, we shall make some generalizations by considering activation functions with 
saturations and apply our obtained results to some special neural networks systems. It 
is shown that our results are general and improve the previously known results. Finally, 
numerical examples are presented to illustrate our results. 



In GNNs (1), the integer N corresponds to the number of units in neural networks and M 
corresponds to the number of neural axons; that is, signals that emit from the zth unit 
have M pathways to the jth unit; u l (t) corresponds to the membrane potential of the ith 
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neuron at time t; the dissipation coefficient Cj(i) > represents the rate with which the 
ith neuron resets its potential when isolated from other neurons and inputs; ay; (t) denotes 
synaptic connection weight of the jth neuron on the ith neuron at time t — Kiji(t); Ji(t) 
is an input to the ith neuron at time t from outside the networks; gj(-) denotes activation 
function; crj denotes the amplifier gain; Kiji(t) is the transmission delay of the ith unit 
along the I axon of the jth unit at time t, it is a nonnegative bounded function with 
< Kiji(t) < Kiji < k := max{Kiji\i,j G J^, I G Jz?}. 

As usual, we denote by C([— n, 0],3? N ) the Banach space of all real-valued continuous 
mappings from [—k, 0] to £% N equipped with supremum norm defined by 

U\\ K = max . U%, where \\cf>% = sup \<P\t)\ 

1<»<JV -K<t<0 

and <f> = (<j>\<j> 2 ,--- ,<f> N ) T G C([-k,%M n ). Let I > 0. For any u G C([-k,1],3? n ) and 
t G [0,;], we define u t (s) = u(t + s), s G [-k,0]. Then we have u t (-) G C([-k, 0], M N ). 
For any given <j) G C([-k,0],& n ), we denote by u(t;<j>) the solution of GNNs (1) with 
Uo(s) = <j)(s) for all s G [— k, 0]. 

Definition 1 (sec [12-13]) 

A continuous function f(t) : 3? — > ^ is called an almost periodic function if for any e > 0, 

ST{U e) = {ref + T) - f(t)\ < e for all t G 

is a relatively dense set in if. That is, there exists a positive constant 1(e) such that any 
interval with length 1(e) contains at least one point of &(f,e). The number T is called 
e-almost period of f(t). 

Let (&/£?*, || • ||) be the space of all real- valued almost periodic functions defined on 3% 
with supremum norm defined by ||/|| = sup |/(t)| for any f(t) G stf . It is easy for us to 

have the following basic properties (see [12-13]): 

(Ai) Let f(t) G stf 3?. Then f(t) is bounded and uniformly continuous for all t G 3%. 

(k.2) Let fi(t) G ■e/^ 2 , i = 1,2,- • • , N. Then for any e > 0, there exists a constant 
1(e) > such that any interval with length /(e) contains at least one common e-almost 

AT 

period of fi(t) for all i = 1, 2, • • • ,N. That is, |"| ^(fi, e) is relatively dense in 8%. 

i=l 

(A 3 ) Let f(t),g(t) G s/&. Then f(t - g(t)) G 
Remark 1 

Assume that f(t),g(t) E For any e > 0, by using (Ai), there exists S = S(e/2) > 

such that |/(ti) — f(t2)\ < e/2 if \h — t 2 \ < 5. We only take e = min{e/2, 5}. It is easy for 
us to check that \ f(t + T - g(t + T)) - f(t - g(t))\ < e for any T G &(f,e) f| &(g,e) and 
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all i e f. From (A 2 ) and Definition 1, we get f(t — g(t)) £ srf 2? . That is, the property 
(A 3 ) holds. 

Throughout this paper, we always assume the following assumptions hold: 

• (Hi) Ci(t) > 0, diji(t), Kiji(t) > and Ji(t) are almost periodic functions defined on 
t%, (Jj > and a ia (t) > 0, where i,j£ J 1 and I £ . 

Unless otherwise stated, we always use i, j = 1, 2, • • • ,N, I = 1, 2, • • • , M. The activation 
functions of first class we considered satisfy the following basic assumption: 

, (\9i(x)\ <B t , 5l (0)- and 
Class A : ft G C , < 

[ (ji{x) > 0, xgi(x) < 0, where x £ 8%. 

Lemma 1 

Assume that (H^ holds. For any 4> = 0\ <f> 2 , ■ ■ ■ ,c/) N ) T £ C([-k, 0},^ n ), 

M N 

|| <p l |U < ( E E SU P I a ^ (*) I B > +sup|Ji(t)|) / inf a (t) 

implies that 

M N 

IK(-;4>)IU < (EE su pi a ^wi^ + su pi^wi)/ in £ c *W 

y ^~{~[tese tern Jl t( ^ m 

for all t > 0, where </>) is the solution of GNNs (1) with uo(s) = (j)(s) for s £ \—k, 0]. 
Proof 

The proof is trivial, we omit it here. 

We introduce the following auxiliary functions 



A I 




Lemma 2 

Suppose that the following assumption holds: 

M 

• (Hf) inf ft (C) < supc,(t) / o l inf Va tlI (t) < sup ft (C). 

Then there exist two points zn and z i2 with zn < < z i2 such that Fj(zjfc) = and 
Fj ( z ). sffn (£^iil\ < (z ? z ik ,k = 1,2). 

Proof 




tions of class A, we know that the graph of positive function ft (z) concaves down and has its 



maximal value at zero. By the continuity of g%(z) and (H^-), there exist two points Za and 
z i2 with zn < < z l2 such that gi{<JiZ ik ) = sup Cj(i) / CTj inf £ tnat is > ^i(z»k) = 

(k = 1, 2). Since gi(z) is increasing on (— oo, Za] and is decreasing on [z i2 , +oo), we get that 



M 

( - supcj(i) +£7i5i(CTi^) inf V a i4i (i) ) -synj -} < 0; 



that is, Fi(z)-sgn\ - — — } <0(z^ z^). The proof is complete. □ 
I z — z a > 

For the existence of 2 N positively invariant basins of GNNs (1), we consider the following 
assumption for activation functions of class A: 

M 

• (Hf) (-If ■ {Fiizik) + Ji(t)\ > ^^supl^WIBj 
for all ief , where k = 1, 2. 

Take fc = 1 in (H£), it is easy for us to get that 

M 

Fi(zn) + V V sup | Oiji(t) | +sup Ji(t) <0. (2) 

Noting that Fi(z) — > +oo as z — ► — oo, we know that there exists a 2h with %\ < zn < 
such that 

M 

+ sup |aiji(*)|-B,- + sup Ji(t) = 0. (3) 

Take fc = 2 in (H^), by the similar argument, we derive that there exists a with 
< Zi2 < z i2 such that 

M 



Fi {z a ) - E E su s i a w (*) i b j + ^ J * (*) = °- ( 4 ) 

Next, we let 



M AT 

«»i : = -( EE^Pl^'iWI-Sj + su Pl J »(*)l)/ inf Cj(i), Ai:=2ii, 

, M N , , 

OLi2 ■■= Zi2, Pi2 ■= { J2 swp\aiji(t)\Bj + sup I Jj(t) I )/ inf a(t). 

x -i=ij=iteM teM Jl 

It is easy for us to check that an < (3n < < a i2 < 0i2- Then we define 2N subsets of 
C([-k,0],@) as follows: 

Xn := |V> € C{[-K,0],@)\i>(s) < Pa for all s e [-k,0]|, 
J^ 2 := {?/> € C([-k,0],^) | > a l2 for all s e [-k,0]|. 



Hence we have 2 N subsets JT E := x ■ ■ ■ x of C([-k, 0},3£ n ), where £ = 

, ' 

JV 

(?i,?2) - "■ >^iv) w ith Q = 1 or 2, i g /. In what follows, we should prove that these J^ E 
are 2 N positively invariant basins of GNNs (1). 

Theorem 1 

Under the assumptions (Hi) and (Hj 4 )-^:^) , each is a positively invariant basin with 
respect to the solution flow generated by GNNs (1). 

Proof 

For any initial condition <f> G J^ s , we should prove that u t (-;<j>) G J£^ s for all t > 0. For 
each i g /, we only consider the case q = 2, i.e., <j) l {s) > a i2 for all s G [— ft, 0]. We assert 
that, for any sufficiently small e > (e <C a i2 — z i2 ), the solution u l (t; <fi) > a i2 — e holds for 
all t > 0. If this is not true, there exists some t* > such that u l (t*) — a l2 — e, < 

M 

and > a l2 — e for i G [—K,t*]. Due to (-ffj 4 ), inf J2 a ui(t) > an d the monotonicity 

of gi, we derive from GNNs (1) that 

A i (r*\ M N 

^ = -c,(fK(f) + ^^a, J ,(f) Sj (<r J ^(f- Kyl (f))) + J,(f) 

i=i j=i 

M 

> - sup c t (t)(a l2 - e) + inf V a 4l( (i)^ (cr, (a l2 - e)) 

M 

- Y sup i°w + M, J * w 

i=i &i ^ te ® 

M 

> Fi(z i2 - e) - YY sup l a y'WI B J + inf J *W- ( 5 ) 

i=i j^i teSf ' 

From Lemma 2, we know that Fi(z) is strictly decreasing on (zi 2 , +oo). By using (4) and 
(5), we get du j* - 1 > which leads to a contradiction. Since the choice of e is arbitrary, 
if <fi l (s) > aa for all s G [— k,0], we have u l (t;<fi) > on 2 for all t > 0. When q = 1, 
similar argument can be performed to show that if 4> l (s) < fin for all s G [— ac, 0], we 
have u l (t;(j)) < /3n for all t > 0. Hence, for any initial condition G J^ s , we have that 
4>) G J^ s for all t > 0. That is, each JT S is a positively invariant basin with respect to 
the solution flow generated by GNNs (1). The proof is complete. □ 

For convenience of discussing invariant regions for the existence of 2 N almost periodic 
encoded patterns of GNNs (1) in next section, we define 2N subsets 3$ik Cj</^ 
k = 1, 2) which satisfy the following two basic properties: 



(Ai) For any <j>(t) G 38 ik , a lk < <j)(t) < (3 ik for all i G 
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(A 2 ) For any e > 0, ^{S§ ik ,e) := f| &(<j>, e) is relatively dense. 



Let 



^ := S§ lqi x ^ 2?2 • • • x 2$ NiN , 

S v ' 

JV 

where E = (ft, ft, ■ ■ ■ , Tat) with q = 1 or 2, j e /. Then S§ik (i g fc = 1,2) are not 
only convex subsets of Banach space but also uniformly almost periodic families (see 

[12]). The compactness of S$ik comes from the following lemma. 

Lemma 3 (see [12]) 

If SB C srf 3? is a uniformly almost periodic family, then from every sequence in SB one can 
extract a subsequence which converges uniformly on Si. 

Lemma 4 (see [26]) 

For any p > 1, x k > 0, y > 0, the following inequality holds: 



fc=l 



where pk > (k = 1, 2, • • • , m) are constants and ^2 p k = p — 1. 

fe=i 



pNxN 



with /ijj < (i 7^ j). Then the following conditions are 



Lemma 5 (see [32-34]) 
Let H = (hij)NxN S 
equivalent: 

(1) All the leading principal minors of if are positive; 

(2) H is quasi-dominant positive diagonal; that is, there exist positive numbers Zj (j G J) 

N N 

such that z jhij > or ^ z jhji > 0, ie/. 

We denote by J£ the set of all matrices which satisfy one of the above properties. For 
any H G let ^(iJ) := |z = (z x , z 2 , • • • , z N ) T e 3l N HZ > and z t > 0, i G J^j. 
It is obvious that fl^(H) is a cone without the vertex in S$ N . Given any H = (hij\hij < 
0, i 7^ ,])nxN- If ^ij > ^ij (*, j € J?) and iJ € . // . then iJ G 



3. ALMOST PERIODIC ENCODED PATTERNS FOR GNNS 

In this section, by using the properties of almost periodicity and Schauder's fixed point 
theorem, we should prove that each ^ s is an invariant region and there exist at least 2 N 
almost periodic encoded patterns of GNNs (1) in these SS^ . Finally, attracting basins are 
estimated and some criteria are derived for the networks to converge exponentially toward 
2 N almost periodic encoded patterns. 
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Theorem 2 

Under the basic assumptions (Hi) and (H^-)-(H^), for each S, there exists at least one 
almost periodic encoded pattern of GNNs (1) in ,^ s . 

Proof 

For each S = (ft, ft, ■ ■ ■ , Cat), we define a mapping = (^p , , • • • , by 

°? r m n 

{&? <t>){t) = a vtt - s ^ (vjPd - s - - «))) 



L 1=1 j=i 



+ Mt-s) 



s 

exp ( — y c i(t ~ u )duj ds, 



(6) 



where i G J , <f> = ((f) 1 , <f) 2 , ■ ■ ■ ,<fi N ) € From (f/i) and the boundedness of activation 

functions, it is easy for us to check that each is well defined. Next we need three steps 
to complete our proof. 

Step 1: For each i £ /, we should prove that a ift < (&f<p)(t) < fa t for all t e Fix 
ie/. From (H{) and (6), one obtains that 

m n °r r 

{&?4>)(t) < ( VVsupK^ISj ■+sup|J i (t)|) /expf- / inf Ci(t)du)ds 

(-1 J-l o 



M N 



< (VVsup|a ij i(t)|fl j +sup|J j (t)|)/ inf Ci {t) = fa. 



= 1 j-=l 



t£ <^ / / test 

If ft = 2 (i e then <^(i) > a i2 for all i e ^. From (6) and (Hf), we get 



(7) 



(&f4>)(t) > ( inf y]a ii( (i)5 i ((T i a i 2) - V Y^sup la^WI-Bj ) / exp ( - / sup c;(i)rfu) cfo 
Vte ^tt tT^*^ 7 J W tea ' 

oo s 

+ inf JAt) / exp ( — / sup Ci(t)du)ds 

te® J v J te® ' 
o o 

M M 

> ( inf y^aui{t)gi((Tiai2) - ^ ^sup \a-iji{t)\ B j ) / supc 4 (t) 



=i j¥» 



+ inf Jj(t) / supci(i) = a i2 , 
' ' ' tern 



(8) 



for all t e f . By (7) and (8), we have < (J^^(p)(t) < fa. From similar argument, 
if ft = 1, we can prove that an < (^p(p)(t) < fa for all ( g f. Hence, we have a^ < 
(&?<j>){t) < /3 iCl for each i e / and all t € ^. 
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Step 2: We should prove that : ^ s 

M N 



For any e > 0, we let 
* = min | | inf a(t) / max [2 2 sup l^'K*)!^') SU P I'M*) I 

M N 



i=i i=i 



From basic properties (A2) and (A3), we know that there exists a positive constant l(e*) 
such that any interval [<;, <r + I] Sf) contains at least one common e*-almost period T, 
namely 



0* (t + T - s - Kiji(t + T - «)) - & (t - s - n l3 i{t - s)) 

M N 

- e * < l /gi ci w/mi? u pi a ^wi ™p 1^(0 1) 



1=1 3=1 



tesi 



(est. 



N 



Oiji (t + T-s)- a ijt (t - s) J < e* < - inf Ci (t) / 2 MB i 

Ji(t + T - u) - Ji(t - u) < e* < % inf c;(t), 

5 teSl 



M N 



i(t + T-u) -Ci(t-u) < e* < \ inf c^t) max { V" V" sup \a i3 i{t)\Bj, sup | Jj(i)| j 

/ ^ r - ' tp« ' 



=1 i=i 



(9) 



For convenience, we define continuous functions Sj(t, s) = exp ( — J c,(t — w)cfai ). From (6), 

v ' 

we get that 



|(^)(t + T)-(^)(t) 

M N 



/ a ^ + r ~ s ^ + r - s - k ^ + r ~ s ))) + J ^ + r - s ) 

B Li=u=i 

* °? r m n 

exp ( - Ci(t + T - u)dujds - / dyifi - sj^^/ (i - s - K tjl (i - s))| 

exp ^ — y Cj(t — u)du^ds 


°? M JV r 

/ 22 1 K< (* + T _ s ) - a ^ (* - s )] 9i (o-j^ (t + T-s - K !3i (t + T - a))) 

S 

x exp ( - / Ci (t + T - u)du)ds + - «) h M' + ^ " * " + T - -))) 



+ Ji(t- s) 
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— g 3 (^g j <\fl (t — s — Kiji(t — s))j exp ^ — J Ci(t + T — u)du^jds 

o 

s 

+ aiji(t- s)g j (^T j (p j (t- s- Kiji(t- s))j cxp J c t (t + T - u)duj 



ds 



cxp ^ — J Ci(t — u)dujds > 



s 

exp ^ — J Ci(t + T — u)duj 



+ Ji{t-s) 

°S M N 



Ji(t + T-a)-Ji{t-a) 

s 

exp ^ — J Ci(t + T — u)dujds — cxp ^ — J Ci(t — u)du^jds 
o o 

< I ^2^2^aiji(t + T - s) - aiji(t - s) gj^o-jc^ (t + T - s - Kiji(t + T - s))^j Sj(f + T,s)ds 

{ 1=1 3=1 

/°° M N 
X] i a *j'(* ~ s )i & ( f + r ~ s ~ + r ~ s ))) ~ & ( f ~ s ~ ~ s ))) 

o i=ij=i 

°? M N 

x Sj(i + T, s)ds+ / [fflijift ~ s )l gj (V^ (t - s - Kjji(t - s))) Ei(t + T,s) -Ei(t,s) ds 

{ 1=1 3=1 

oo oo 

+ J Ji(t-s) Ei(t + T,s)-Ei(t,s) ds + J J i (t + T-s)-J i {t-s)E i (t + T,s)ds. (10) 



By using (Hi), (9)-(10) and mean value theorem of differential calculus, we obtain that 

M N °° s f M N 

{&?4>){t + T)-{&?4>){t)\ <e*J2J2 B i / CX P(- / t in | Ci (t)d«) d* + ^ ^ sup | ^(t) | 

oo s 

x y l&Wkj <P(t + T - s - Kiji(t + T - s)) -<jp{t- s- n l3 i{t - s)) exp ( - J mf Cj(t)du) 
o 

+ V V ( sup |aiji(t)|Sj + sup \Ji(t)\) / / exp(0) Cj (i + T - u) - Ci(t - u) 



oo 





duds 



o o 



+ e* y cxp ^ — y inf Ci(t)dujds, 



(11) 



where lies between ajcjp (t+T—s—Kiji(t+T—s)) and (t— s— Kiji(t— s)) , 9 lies between 

s s s s 

— / Ci(t + T — u)du and — J Ci(t — u)du. Noting that — J" sup Ci(t)du < 6 < — J inf Ci(t)du, 
oo o test o * e -^ 



10 



it follows that exp(0) < exp(— s inf Ci(t)). Therefore, by using (9) and (11), we have 

JV 

Ci(t)du ) ds 

— I I- ■/, / \ . / I -.7, 

3- 
M \ 

+ e* 



(^0)(t + T)-(^0)(i)| < e*^MS,/ inf *{t) + e* J exp (~ J inf 

• J=1 o o 

M JV °° 

V^VVsup |a i:7 -/(t)|Bj + sup I Ji(i)|) / exp(-s inf Cj(t))sds 



M JV 



e *J2Yl a i sup l a ^WI SU P 1^(01 / inf Ci(t) < e, (12) 



which leads to the almost periodicity of ^ s ((f)). From Step 1, it follows that ^ s : ^ s — > 
That is, each ^ s is invariant region of ,^ s . 
Step 3: We should prove that ^ s : ^ s — > ^ s is continuous. Take any two 0i, 02 € 
From (6) and Lagrange's mean value theorem, we have 

°j! M N 







5 i=i j=i 

s 

9j{^j<t>{( t ~ s~ Kiji(t - s))) - gj(aj((P 2 (t - s - Kiji(t - s)j) exp ^ - y Cj(t - u)dujds 



M JV 

< V V sup | a y/ (i) I ctj sup ffj(C)/ inf c;(i)||0i -02 1|, 
which leads to 

M JV 

1 1 ^ E 0i - ^ E 02 1 1 < max { V V sup \aiji(t)\ a 3 sup & (Q / inf a (t) } || 0i - 2 1 1 . 

This implies that ^ s is continuous with respect to € ■ 

From Lemma 3, each is compact convex subset. Since : ^ E — ^ ^ s is continuous, 
by Schauder's fixed point theorem, there exists at least one us € <^ E such that = uj. 

It is easy for us to check that 



/ [HX! a w( s )9j (vjUvis - Kyj( s ))) + ex P ( - / Q(u)cZu)ds 

-oo ' = 1 = 1 s 
M JV 

;=i i=i 

Hence Mx;(t) is an almost periodic solution of GNNs (1) in The proof is complete. □ 

From above theorem, we know that each ^§? s is an invariant region of GNNs (1) and 
there exist at least 2 N almost periodic encoded patterns in these In what follows, we 
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should prove that each j£^ s is an attracting basin for almost periodic encoded pattern in 
^ E under our additional assumptions. For convenience, we take the following notations: 

M 

C = diagl inf Ci(t), inf C2(t), • • • , inf Cjv(t) ) , W=(?i,,) with 7L,- := >sup |a{,-i(t)|, 

\tese test t^m ) \ J nxn f— < 



g = dia5^o"i5i(C), 0-252(0) ■■ 1 ,OAr<?jv(0) with ^(0 = max {#;(;>:) z = c^Ai, 0^2}. 
Next, we should introduce two additional assumptions: 

• (Hf) C-H$£Jt. 

• (Hf) There exist positive constants p > 1, dj, o^, and pjik such that 

M N 

pdiwtaw > ^^k(sup| a ^(oi) m, ' m+1 (^(o) Pto "" +1 



1=1 i=i 

m 

+ Y. d MsMa l M) mik/0k (°MQ) pq]lk/0k 



k=i 



f ^ ub m+1 z/t-t-j- 

where &(0 = max z = a^n,^^ \, X) o fe = p - 1, J] = ^ PjJfc = 1 for 

L J fc=i fc=i fc=i 

each j £ J' and Z e Jz? , m is a positive integer. 

Theorem 3 

Under the basic assumptions (Hi) and (H^)-(H^), for each S, there exists a unique almost 
periodic encoded pattern of GNNs (1) which is exponentially stable in 

Proof 

From Theorem 2, there exists an almost periodic solution u of GNNs (1) in each For 
any initial condition <f> G J?T S , by Theorem 1, we know that x t (-;<f>) € JT S for all t > 0. 
Under translation y(i) = u(t) — x(t; 4>), we get that 

M N 



m+1 



dyHt) 

dt 



- Cl {t)y\t) °«'(*) [& ( a ^ j (t - Kijiit))) - g 3 \u 3 x\t - «yj(t)))J . (14) 

1=1 3=1 

From (H^) and Lemma 5, there exists a K = (K\,K2, - ■ ■ ,Kn) t £ SljtiC — TLQ) such 
that sup \u l (9) - 4 (6»)| < K t . Then we get that 

0€[-re,O] 

M JV 

tek Ci ^ Ki ~ S X l a ^)K&(0^ > 0, 



i=i i=i 



where <?j(0 = max {.9.J ( z ) z = cr j0jii< J j a j2^- We consider the single-variable functions 
Wj(-) defined by 



M N 



WW = (inf a(t) 6)K t -EEL u g loiiJ Wkift-(C)^e 9 ^'. 



1 j= i *e* 
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Noting that Wj(0) > and Wi(9) — > — oo as — > +00, there exists a suitable /z such that 
for all i e J^, 



M JV 



(inf Cj(t) - m)^ - EE su P I°«»(*)ki5i(0^-e'" t «' > 0. (15) 
te® l=1 j=1 tern 

Consider function Zi(t) = e*** | y* (t) | where t G [— k, 00). Let p > 1. It is obvious 
that Zi(t) < gKi for all t G [-K,0]. Now we claim that Z;(i) < pi^ for all t > and 
i S /. Otherwise there is a first time to > and some i* 6 / such that Z*. (io) = £>-?Q*, 
rf+|Z ^ (to)l > and Zj-(t) < (xfg (j 7^ i*) for all f G [-Mo]- From (14), we derive that 

where £ lies between ajU^(to — «i*ji(io)) and ajX^(t — Ki*jt(to)). From above inequality 
and (15), we get that 



d+lZi : {t ° )l < -( inf C4 ,(t)- M )^(t ) + £^ 

M JV 



< -( inf c i .(t)-//)Z i .(t )+ V Vsupla^^la^^Oe^*^ sup Z,-(0) 



M AT 

< -( inf a,(t) -ii)gKi. + V y2 su P\ a i'ji( t )\ (J j9j(Oe ,1Ki ' j, QK j < 0, 

|=1 j=1 te * 

which leads to a contradiction. Hence Z;(f) < jxfQ for alH > and i G J 1 . That is, there 
exists a positive constant g such that 

\u\t) - x\t- cf>)\ < e~^g sup \u\9) - 4 (6»)|, 

9€[-k,0] 

for alH > and i G ,f . Therefore, for each E, there exists a unique almost periodic encoded 
pattern u(t) which is exponentially stable in The proof is complete. □ 

Theorem 4 

Under the basic assumptions (Hi), (_ffj 4 )-(i?2 4 ) and (Hf), for each S, there exists a unique 
almost periodic encoded pattern of GNNs (1) which is exponentially stable in J^ E . 

Proof 

From Theorem 2, there exists an almost periodic solution u of GNNs (1) in each ^ s . For any 
G JT E , by Theorem 1, we know that x t (-, 4>) G JT S for all t > 0. Let y(t) = u(t) - x(t; 4>). 

N 

We consider the Lyapunov functional V(y)(t) = di\y l (t)\ p , where di > 0. From (14), we 
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can derive that 

N M N 



d+V ^ m <Y^pd i \y i {t)r 1 {--mi cMy\t)\ + J2J2 s ^\ a M^9AC)\y J (t-^Am} 

dt i=i tern i= u =i*6* 

N M N 

^ -pE { ^)<WWI P - EE^I^Wr 1 su p K^)k;ft(C)|y^ - ^(*))|} 

1=1 z=l j=l tem 

N M N m 

^ -pEUl c *(W(*)i p -EE^n [(supia^wo^^feco^^i^wi] " 

i=l Z=l j=l fe=l 

x [( sup K-,(t)|) w, ' m+1 fo&(C)r ,,m+1 - } 

N M N , m 

* -pEi^wwr ^-EE[^E^( su pi^wi) p ^ /Ofc fe(0) Wfc/o ' t iy i wi p 
i=i «=i j=i p k=i * e5? 

+ ^( sup |a yJ (i)l) mi ' m+1 fafcfc)) w "" +1 |v*(* - ^i(t))\ P ] } 



iV M N m 



< - £ U bfc,(t) - E E E »p wi) wW °* (^-(op^l iv*(*)i 



W M AT 

+ E[EE d i( su pi o ^(*)i) Wi,,m+1 Mi(o) M " ,m+1 l|» < (*-«i«w) 



i=i j=i j=i 

< - a V(j,)(t)+/J sup V(y)(s), (16) 

£— K<S<t 

where 

m at 



a = mm{M inf c,(i) - V VV^sup |a ij - J (t)|) RPi, * / ° fc ( O - J -ft-(0) P,,,fc/o *}, 

1=1 j=l k=l tfc ^ 
M AT 

/? = max { £ E d * ( SU P l«i«(*)D M, " ,m+1 (<™(0r ,,m+1 }• 



M AT 

i=i j=i te ^ 

From (Hf), we have a > /3 > 0. By using Halanay inequality, we get for all t e 



V(y)(t) < ( sup exp(-Tt), (17) 

where 7 = a — [3e 1K . It follows that 

^l^-^^^e-^^W^ sup fi^)-^)'. 

min i«0 ee[- K ,o] 

Hence u(f) is exponentially stable. The proof is complete. □ 
Remark 2 

When c,, a^;, k^/, Ji : M — > ^ are w-periodic functions with w > 0, we also obtain 
the existence and exponential stability of 2 N periodic solutions of GNNs (1). Our results 
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in Theorem 3 and Theorem 4 are distinguished from the existing results on the following 
points: (i)Most of the previous results of neural networks only focus on the existence and 
stability of unique almost periodic (periodic) solution. Hence, we extend the related results 
[20-31,37,39,41] to the convergence analysis of multiple almost periodic (periodic) solutions. 
(ii)We not only establish existing regions for almost periodic solutions, but also estimate 
attracting basins of these almost periodic solutions. (iii)Our sufficient conditions (H^)- 
(H^) are dependent of system parameters and derivative of activation functions on boundary 
points which make our results new in the literature. 

Remark 3 

M 

From (H^), we know that Fi(zi 2 ) — 2 SU P \ a ijl(t)\Bj + ml Ji(t) > 0- It is obvious that 

i=i j=a tern te -* 

M 

Fi{zi2) + SU P \ a iji(t)\Bj + SU P Ji(t) > 0- Together with (2), there exists a zn with 

M 

zn > zn such that Fi(zn) + SU P \ a ijl(t)\Bj + SU P -M*) = 0- Similarly, there exists 

M 

a %2 with z i2 < z i2 such that Fi(zi2) — S SU P \ a iji(t)\Bj + inf Ji(t) = 0. For each 

i=ijjtitese te -* 

S = (<?i,C2, • • • , Qv), we denote 

S s := jz = (zi, z 2 , ■ ■ ■ , z N ) T Zi € [zi^,Zi^], i = 1,2, • • • ,7V and C — 7Y£/ € | , 

where Q = diag^\g\{<j\Z\),02g , i{p , iZ2)i • • • , ^^(ctjv^at)^ • Under the basic assumptions 
of Theorem 3, we have S s 7^ 0. Assume that there exists a z £ S s such that (i)Q = 1, 
^ > sup \ Zi \ (zi > z a ); (ii)ft = 2, z; < inf i z l I (z; < z i2 ). For each S, we let (i)$ = 1, 

:= (ii)Q = 2, a i2 := z,. From Theorem 1 and Theorem 3, we know that each 
J^ s := x J^> ?2 • • • x J^nsn i s a larger attracting basin. 

S v ' 

JV 



4. SOME GENERALIZATIONS AND IMPROVEMENTS 

In this section, we should make some generalizations by considering the second class of 
saturated activation functions and make some improvements by applying our results to 
some special cases. The second class of activation functions we considered in this paper 
satisfies 

!Uji if — 00 < x < £ji, 
g~j{x) if lj\ < x < £j2, 
Uj2 if £j2 < x < +00, 

where Tjj € C 1 is an increasing function with gj(0) — 0, £j\ < < £j 2 and —00 < Uj\ < < 
Uj 2 < +00. Similarly as Lemma 1, it is easy for us to have the following lemma. 
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Lemma 6 

Assume that (Ht) holds. For any </> = 1 , <j> 2 , ■ ■ ■ ,c/) N ) T e C([-k,0],& n ), 

M N 

\\4>%< (XIXZ SU P lo-ij^C*)! • max + sup / inf a(t) 

x j~ x ~T Y test fc=i,2 L J tGS? 11 test, 

implies that 

M N 

K(-;<A)IU < ( VVsup|ayiW| • max \\u jk \} +sup|Ji(t)|) / inf Ci(t) 

for all t > 0, where </>) is the solution of GNNs (1) with Uo(s) = (ft{s) for s e [— k, 0]. 
Remark 4 

Since each activation function of Class B is bounded with |<?j(x)| < max ||wjfe||, j £ 
As similar proof of Lemma 1, it is easy for us to get the result of Lemma 6. 

For activation functions of class B, we consider the following two parameter assumptions 
which are used to establish the existence and stability of 2 N almost periodic encoded patterns 
of GNNs (1): 

M 

• {Hf) : sup Ci (t) < inf Vtt H (f)4(0, C € [in, fa], 
test teM i~[ 



• (Hi) :(-l) fe • { - supc 4 (i)^ + inf yWtJujfc + J^t)} 

M 

> V Vsup|ay 7 (f)| • max {|^ fe |} 

r - : rr: te^ fe=1 < 2 >- J 

;=i 

for all te where i € and fc = 1, 2. 



Take fc = 1 in (-fff ), it is easy for us to derive that 

M 

y 

'test " k=1 - 2 ( " J test 



Fi(-) + y y sup \aiji(t)\ ■ max \ \u jk \ \ + sup J 4 (t) < 0. 
a rr rr: test. fc=i,2 1 j tP » 



- - in 

Noting that Fi(z) — » +00 as z — > —00, we know that there exists a £ji with ^1 < — < 
such that 

M 



+y^y^sup|a ij 7(i)| • max \ \u jk \ \ + sup Ji(t) = 0. 
^ ^r? test k=1 > 2 L J test 

Take fc = 2 in (H®), by the similar argument, there exists a fa with < — < g i2 sucn that 

M 

Fi(fa) - y~] y~] sup |o»ji(*)| • max I \ujk\ \ + inf Jj(t) = 0. 
T~l ~T- test fe=i,2 J te^ 

=1 
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For convenience, as Section 3, we also take the following denotations: 




aa = (-12, fii2 = ( X) 2 SU P \ a ijl(t)\ ' max + SU P I / inl c »(*)- 

v ;=U=ite« fe=i,2 L J te3? // test; 



It is easy for us to check that an < fin < < <Xi2 < fi%2- The assumption (iff) implies that 
Fi(z) is increasing on [£a/ai, £i2/&i]- Similarly as Theorem 1 and Theorem 2, we have the 
following two theorems. 

Theorem 5 

Under the assumptions (Hi) and (Hf )-(Hf ), each J^ E is a positively invariant basin with 
respect to the solution flow generated by GNNs (1). 

Theorem 6 

Under the basic assumptions (Hi) and (iff)-(iJ^), for each E, there exists at least one 
almost periodic encoded pattern of GNNs (1) in 8§^. 

Remark 5 

From (Hi) and piecewise linearity of activation functions in class B , we know that F t (z) is 
strictly increasing on [£n/(Ti, P-a/vi] and is strictly decreasing on (-co, £n/(Ti)U(£i2/(Ti, +oo). 
By the definition of £n,£i2 and similar proof of Theorem 1, it is easy for us to know that 
each J^ s is a positively invariant basin with respect to the solution flow generated by GNNs 
(1). By Schauder's fixed point theorem and positive invariancy of each J^ s , similarly as 
Theorem 2, we can show that there exists at least one almost periodic encoded pattern of 
GNNs (1) in 

Since each lies in the saturated parts to the activation functions of class B, we get 
that (ji(z) — for all z £ [— oo, <Ti£n\ \J\<J%ti2, +oo], that is, C — HQ £ jtf always holds. The 
exponential stability of almost periodic solutions of GNNs (1) follows as: 

Theorem 7 

Under the basic assumptions (Hi) and (Hi)-(H®), for each S, there exists a unique almost 
periodic encoded pattern of GNNs (1) which is exponentially stable in 

Remark 6 

When Cj, a^;, Kiji, Ji : 8% — > 8% are ^-periodic functions with ui > 0, we also obtain the 
existence and exponential stability of 2 N periodic solutions of GNNs (1). For activation 
functions of class B, we let fin := —in/vi, oti2 := £12/ '<*%■ From Theorem 6 and Theorem 7, 
we can prove that each J^ E := J#i Sl x • • • x Jf/v ?JV is a larger attracting basin. 
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Now we should consider some special case of GNNs (1) and compare our results with the 
existing ones. When Cj(i) = Cj, M = 2, Hij\{t) = and <jj = 1, GNNs (1) reduces to the 
following GNNs considered by [20]. 

duUt) N N 

- - Cl u l (t) +Y j a ij i{t)g j {u\t)) + J2a ij2 (t) gj (u^t - Kij2 (t))) + Ji(t), (18) 

where «e^={l,2, • • • ,N}. From Theorem 2 to Theorem 4, it is easy for us to have the 
following two corollaries. 



Corollary 1 

For activation functions of class A, assume the following conditions hold: 

Q ■ 

< sup 



GAi): inf. 9,(0 < 

^ ct, inf 

test. 



aui(t) + a ii2 (t)\ Ce« 



(A 2 ): (-l) k -{F l (z lk ) + J l (t)}>J2J2 su f\ a M\ B i ( fc=1 > 2 )> 

;=i teSS 

(■4a): C-HQ^Jt or 

2 A? 

(^) : Mc, > EE Uj{sw\aMt)\r ihm+1 {m) qqihm+1 



(19) 



i=i j=i 



Ed i o k {snp\a ijl (t)\) m,k/Ok {g j (0) 



\pqjik/o k 



k=l 



test. 



where C = diag(c\, c 2 , ■ ■ ■ , ca^, gj(S,) = max jg., (;z) z = ajf3ji,ajaj 2 ^; z ik are defined in 

m 

Lemma 2; p > 1, di, o k , qjik and pjik are positive constants which satisfy with °k = P~ 1 5 

fe=i 

m+l m+1 

Qjlk = X) Pj'ife = 1 f° r cacn j € I € 1 ■ Then there exist only 2^ almost periodic 

k=l k=l 

encoded patterns of GNNs (18) which are exponentially stable. 
Corollary 2 

For activation functions of class B, assume the following conditions hold: 

(Si) : c t < inf \a m (t) + a ll2 (t) ^(C), C € [^1,^2] 

(B 2 ): {-l) k • { - + inf fa«i(t) + aii 2 (t)l«ifc + Ji(t)j 
2 

VVsuplay/WI • max {|u jfc |} (fc = 1,2). 
Litem k=\. 2 v > 



(20) 



Z=l j^i 

Then there exist only 2^ almost periodic encoded patterns of GNNs (18) which are expo- 
nentially stable. 

Remark 7 

For activation functions of class A, if we only assume that \gi(x) — gi(y)\ < Li\x — y\ for all 
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x, y e where Li are positive constants. Let Q = diag{L\, L 2 , ■ ■ ■ , £jv) • Under the basic 
assumption (^3), there exists a unique almost periodic encoded pattern of GNNs (1) which 
is globally exponentially stable, we can refer to [20]. 

Assume that a(t) = a, a,iji(t) = a i]U Ji(t) = Ji, aj = 1, n ijh {t) = and n io i 2 (t) = K ijh , 
where h e 2 2 G ^2 and ££\\\££ 2 = Then GNNs (1) reduces to the following 
autonomous general neural networks including [6,8] as our special cases. 

duHt) N N 

= -c lU \t) + e E a ^( u 'w) + E E K iji)) + ( 21 ) 

where i€ From Theorem 2 to Theorem 4, it is easy for us to have the following two 
corollaries. 

Corollary 3 

For activation functions of class A, assume the following conditions hold: 

'("^) : jgt&(0 < m % < su Pff»(C), 
(=1 

M 

(-4 2 ): (~l) k ■ {Fi(zik) + J t } >EEl a ^ ( fc=1 > 2 )' 

1=1 j=ii 

(A 3 ) ■■ c-ng or 

M N 



{At) : vdiCi > EE [^l«^r Pi; ^ +1 (^(O) 9 ^'^ 1 + 51 ^o^la^H^^- 7 ^ (^(0)' 



xiufc|u,iji|--- ■ \yj\qj 

2=1 3=1 " fe=i 



where C = diag(c 1 ,c 2 ,- ■ ■ ,c N ^, = max {<?.,• (z) z = cr^i, (Tja^; p > 1, dj, o fe , g jife 

m m+1 m+1 

and Pj-;fc are positive constants which satisfy with ^ = p — 1, q^fc = pjj^ = 1 for 

fe=i fc=i fe=i 

each j & J?, I e Jzf. Then there exist only 2^ almost periodic encoded patterns of GNNs 

(21) which are exponentially stable. 
Corollary 4 

For the activation functions of class B, assume the following conditions hold: 

M 

(Si) : c, < E a «i CT iffi(C). C G [^1,^2] 

(B 2 ) : (-l) fe • { - c 4 — + E a ^ u «fe + J i \ > EE a ^ 7 ' iB ax \ \ u i k \ f 

(=1 2=1 jjii 

where k = 1,2. 

Then there exist only 2^ almost periodic encoded patterns of GNNs (21) which are expo- 
nentially stable. 
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Remark 8 

In Corollary 3-4, 2 N almost periodic encoded patterns of GNNs (21) are indeed equilibria 
which are exponential stable. We can replace activation functions of class A by 

j g l e C 2 , -q, < gi{x) < rji, gi{x) > 0, 

\ (x - diYg^x) < 0, for all x G 

where rji, rji and di are constants with rji < rji, i e J . There exist 2 N equilibria of GNNs 
(21) which are exponentially stable. When M = 2, Jzfi = {1} and J£ 2 = {2}, the related 
results in [6,8] are the direct results of Corollary 3 and Corollary 4. It is obvious that our 
results are more general than corresponding results in [6,8]. 

Remark 9 

Our approach can also be adapted to the following general neural networks: 

M N 



du l {t) 



= -c t (t)u l (t) +^2^2a ij i(t)g j (a j / K^^u 3 (t - s)ds^j + Ji(t), 



or 



dt 

1=1 3 = 1 



du*(t) _ 



CTjU J (t - Kijl(t))j + Ji{t), 

Kfjt 

where Km : [0, Hiji] — > [0, +oo] is assumed be to continuous and < J Kiji(s)ds < oo, 

o 

Ni(i) = {i — I, - ■■ , i + I}, mji < +oo. The above general neural networks include [24,38- 
39,41] as special cases. Furthermore, our theory generalize stability and existence of multiple 
almost periodic (periodic) solutions to above general neural networks with delays. For more 
practical applications of multistability of neural networks, we can refer to [1-3,6-9,48-51]. 

5. NUMERICAL ILLUSTRATIONS 

Example 1 

Consider the following neural networks under almost periodic stimuli. 

= -(1.2 + 0.2cos2i)xi(i) +3gi{xi(t)) + smV7tg 2 (2x 2 (t)) 
+ (4 + sin V2t)gi(xi(t)) + cos V3tg 2 (2x 2 (t - 9 - sint)) + 1.1458 cos \/5t, 

= -(3 + 0.1sin3f)x 2 (t) +coaV3tg 1 {x 1 (t)) + 4g 2 (2x 2 (t)) 
+ sin s/Zt gi (x 1 (t - 7 - 3 cos t)) + (7 + cos \/3t)g 2 (2a; 2 (t) ) + 4.6679 sin 2t, 



(24) 



where gi(£) — g 2 {0 = tanh(£), which belongs to class A. It is easy for us to get that 
F^z) = -1.42! + 6g(z), F 2 {z) = -3.12 + 10g{2z). 
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From some computations, we have z\\ = —1.3565, 212 = 1.3565, z 2 i — —0.792, z 22 = 0.792 
such that Fi(zik) = 0. Then fi(z u ) = (-l) fc 3.3544 and F 2 {z 2k ) = (-l) fc 6.7370 where 
k = 1, 2. From Lemma 1 and (3)-(4), we can have the following calculation result: 

an = -11.1458, /3 n = -1.8190, a 12 = 1.8190, 12 = 11.1458, 
a 21 = -6.4372, (3 2l = -0.9095, a 22 = 0.90 95, (3 22 = 6.43 72. 

It is easy for us to get 

31(C) = max j.gi(» z = /3u,a 12 } = 0.1, 2g 2 (C) = max|g 2 (z) z = 2f3 21 ,2a 22 ^ = 0.1. 

Therefore, the parameters satisfy our assumptions in Theorem 3: 
Assumption (H^): 



< supci(t)/ inf (oiu(t) +oii 2 (t)) = 1-4/6 < 1, 
test 1 

< supc 2 (t)/2 inf (a 22 i(t) + a 222 (i)) = 3.1/20 < 1. 
tern I test 

Assumption (H^): 

(-l) fc -{F 1 (z lfc ) + ,h(t)} = (-l) fe -{(-l) fe 3.3544 + 1.1458 cos VEt} 

> 2 = sup \a 121 (t)\B 2 + sup \a 122 (t)\B 2 , 

test test 

{-l) k ■ {F 2 {z 2k ) + J 2 {t)} = (-l) fe -{(-l) fe 6.7370+ 1.6679sin2t} 

> 5 = sup |a 2 n(i)|Si + sup |a 2 i2(*)|-Bi. 

test t^se 

Assumption {H^)\ 

/l 0\ _{8 2 W 0.1 \ / 0.2 -0.2 
y \ 2.9 J \ 2 12 J \ 0.1 J \ -0.2 1.7 

Then there exist four almost periodic encoded patterns of (24) in and their attracting 
basins are We can compute the following regions: 

Region I: (-00, -1.77] x [0.9, +00), Region II: [1.77, +00] x [0.9, +00), 

Region III: (-00, -1.77] x (-00, -0.9], Region IV: [1.77, +00] x (-00, -0.9] 

which contain larger attracting basins mentioned in Remark 3. From Figure 1, we can see 
that four almost periodic encoded patterns of (24) lie in invariant regions 3§^' 2 \ 3§( 2 ' 2 \ 
J?' 1 ' 1 ) and J?' 2 ' 1 ) which borderlines are plotted in blue. Their larger attracting basins are 
denoted by Region I to Region IV which borderlines are plotted in black. 
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Figure 1: Convergence dynamics of four almost periodic encoded patterns of (24). 



Example 2 

Consider the following neural networks under periodic stimuli. 
( dx\{t) 



dt 



dx 2 (t) 
dt 



-1.4ci(t) + 2 gi (xi(t)) + 0.1. 92 (2x 2 (t)) 
+4g 1 (x 1 (t - 10)) + 0.\g 2 {2x 2 (t - 10)) + 3.1456 sini, 

-3.1x 2 {t) + 0.1 gi ( Xl (t)) + 3g 2 (2x 2 (t)) 
+0.lg 1 (x 1 (t - 10)) + 7g 2 (2x 2 (t - 10)) + 6.1705 cost, 



(25) 



where gi (£) = g 2 (£,) = tanh(£), which belongs to class A. Similarly as Example 1, we can 
check that (Hf) and (H 2 ) hold. From Lemma 1 and (3)-(4), we can have the following 
calculation result: 

a n = -6.6754, /3 n = -1.443, a l2 = 1.443, 12 = 6.6754, 
a 21 = -5.2808, foi = -1.0891, a 22 = 1.0891, /3 22 = 5.28 08, 

fli(C) = max - /3n,a 12 } = 0.2, 2g 2 {() = max {2.g 2 (z) |z = 2/3 21 ,2a 22 } = 0.1. 

Let p = 4, m = 1, Oi = 3, g^ = = 1/2 (i, Z, fc = 1, 2). From some calculations, we can 
check that (H^) holds. Therefore, by Theorem 4, there exist four periodic encoded patterns 
of (25) in Their attracting basins follow as: 
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Figure 2: Convergence dynamics of four periodic encoded patterns of (25). 



Region I: (-00, -1.443] x [1.0891, +00), Region II: [1.443, +00] x [1.0891, +00), 
Region III: (-00, -1.443] x (-00, -1.0891], Region IV: [1.443, +00] x (-00, -1.0891]. 

We can refer to their convergence dynamics plotted in Figure 2. 

Example 3 

Consider the following neural networks under almost periodic stimuli. 

= -(1.5 + 0.5cos\/7t)xi(t) + (4.5 + 0.5 sin V2t) 3 i (0.5a;i (t)) + 0.1 sintg 2 (0.25a;2(t)) 
+ (2.5 + 0.5sinV2t) 5 i(0.5xi(t - 10)) + 0.1 cost 92 (0.25x 2 (i - 10)) + 0.2 sin 3t, 

dX2 ^ = -(0.75 + 0.25sini)a;2(t) + 0.2cosV5tgi(0.5xi(t)) + (8 + cos V3t)g 2 (0.25x 2 (t)) 

+0.2 sin \fftg\ (0.5xi (t - 10)) + (2 + cos V3t)g 2 (0.25x 2 (t - 10)) + 0.05 cos 2t, 

(26) 

where <7i(£) = g 2 (£.) = + 1| + |£ — 1|), which belongs to class B. Similarly as Example 
1, we can check that {Hf) and (H2) hold. From Lemma 1 and (3)-(4), we can have the 
following calculation result: 

an = -8.4, (3 n = -2.8, a 12 - 2.8, f3 12 = 8.4, 
a 2 i - -24.9, p 21 = -7.55, a 22 = 7.55, f3 22 = 24.9. 
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Figure 3: Convergence dynamics of four almost periodic encoded patterns of (26). 



By Theorem 7, there exist four stable almost periodic encoded patterns of (26) in . It 
is obvious that their larger attracting basins follow as: 

Region I: (— oo, -2] x [4, +oo), Region II: [2, +oo] x [4, +oo), 

Region III: (-oo, -2] x (-oo, -4], Region IV: [2, +oo] x (-oo, -4]. 

Their convergence dynamics are illustrated in Figure 3. 

Example 4 

Consider the following neural networks under periodic stimuli. 



where <?i(£) = 52(C) = + 1| + |£ — which belongs to class B. Similarly as Example 



' dxi(t) 
dt 



= -(1.5 + 0.5cost)a;i(i) + 10gi(0.5a;i(t)) + 0.1g 2 (0.25x 2 {t)) 
+3g 1 (0.5x 1 (t - 10)) + 0.1g 2 (0.25x 2 (t - 10)) + 0.2sin4t, 



dx 2 (t) 
dt 



(27) 



= -(0.8 + 0.2smt)x 2 (t) + O.20!(O.5a;i(i)) + 9g 2 (0.25x 2 (t)) 
+0.2. 9 i(0.5xi(t - 10)) + 3g 2 (0.25x 2 (t - 10)) + 0.05cos8i, 



1, we can check that {Hf) and (H 2 ) hold 



By some calculations, we can have the following 
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Figure 4: Convergence dynamics of four periodic encoded patterns of (27). 



result: 

an = -13.4, fin = -6.3, ai2 = 6.3, (3i 2 = 13.4, 

a 2 i = -20.75, flu = -11.55, a 22 = 11.55, (3 22 = 20.75. 

By Theorem 7, there exist four stable periodic encoded patterns of (27) in S3 1 -" . Their larger 
attracting basins follow as: 

Region I: (-co, -2] x [4, +oo), Region II: [2, +oo] x [4, +oo), 

Region III: (-co, -2] x (-co, -4], Region IV: [2,+co] x (-co, -4]. 

For their corresponding convergence dynamics, we can refer to Figure 4. 

6. CONCLUDING REMARKS 

In this paper, we investigate multi-almost periodicity of general neural networks under 
almost periodic stimuli. Invariant regions and attracting basins are established to investigate 
existence and exponential stability of 2^ almost periodic encoded patterns. Our results 
extend and generalize the related results reported in the literature [6,8,10,20-23]. 
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